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ABSTBACT 

This inquiry determines the degree of relationsliip 
between observed faculty personal characteristics and judged teaching 
effectiveness. Students in a liberal arts college rated faculty on 
two typical teaching evaluation instruments and on a semantic 
differential form* Data came from 1^500 student judgments on 1C8 
faculty (86 percent). Factor analysis, analysis of variance, and 
multiple regression analyses shoved that (a) personality and teaching 
effectiveness were highly correlated (.77), (b) factors derived from 
the semantic differential predicted a multiple B= 0.88 for teaching 
effectiveness, and (c) dynamic, pragmatic, amicable, and highly 
intellectually competent faculty received statistically significantly 
higher teaching competence ratings than did professors tending toward 
the opposites of these traits. The findings suggest that improvement 
of teaching effectiveness may depend more on changes related to 
personality factors than on those involving classroom procedures. 
(Author) 
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PERSONAL CHARACTERISTICS AND TEACHING EFFECTIVENESS OF COLLEGE FACULTY . 

Introduction 

Calls for in^rovcd college teaching and a proper evaluation of 
faculty performance Iiave a long history (Jordan, 1906; Wilson, 1942; 
Ebie, 1970) • Apparently, however, the pleas have failed to produce the 
desired results Today the cries are as intense as ever. They come from 
students feelirag deprived of stimulating instruction, from external sources 
demanding accountability of a professor's work, and from administrators and 
peers facing dlfflctilt academic staffing decisions. A tight and constrict- 
ed' job market focuses attention on promotion procedures, especially with 
respect to awarding tenure. Teaching effectiveness is a principal criter- 
ion in the process of faculty evaluation. Hence, insights into factors 
affect:lng this criterion are needed for many good reasons. This study sup- 
plies data relevant to the assessment of faculty performance. The research 
examines the relationships among different dimensions of teaching behavior 
in terms of student ratings of effectiveness and develops predictive cri- 
teria concerning student perceptions of effective college teachers. 

A major problem in evaluating teaching effectiveness stems from a lack 
of agreement on appropriate criteria (Mitzel, 1960: 1481; McKeachie, 1969; 
Hlldebrand and Wilson, 1970)* Part of this difficulty relates to research 
techniques which have not adequately established the relationship between 
personality characteristics and classroom teaching behaviors. This study 
is based on the conceptual premise that effective college teaching depends 



less on faculty behaviors directed toward the functional management of a 
class ^itid more on personality factors which students perceive to be relev- 
ant in the teaching/learning environment. Stated somewhat differently, an 
instructor's skill in organizing and managing his course requirements is a 
necessary but not sufficient condition for achieving effectiveness in the 
classroom. It is the personal qualities which the instructor as an indi- 
vidual brings to the educational setting that spell the difference between 
success and failure as a teacher, at least insofar as student judgments are 
concerned. 

The study was conducted at a typical liberal arts college. Data were 
obtained on two student evaluation forms and a semantic differential in- 
strument for 108 of the 125 member faculty. The college's Office of 
Institutional Research (IR) provided one set of student- judged teaching 
effectiveness scores from the institution's ongoing practice of evaluating 
instruction. The IR instrument assessed presentation of course content 
and instructor's attitude toward students. Careful inspection of the items 
Indicated a definite emphasis on the teacher's ability to develop positive 
interaction with students through the medium of the discipline. Students' 
ratings on this form reflected their perceptions of the instructor's skill 
in communicating subject matter and, in addition, his proficiency in 
facilitating the interaction process. In most cases instructors were rated 
by about 85% of their students. 

A student-run and published evaluation of faculty teaching effective- 
ness (Pequod) gave a second measure. Although similar in style to the IR 
form, Pequod differed substantially in content. This instrument focused 
almost exclusively on functional aspects of the course, including concerns 
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about fairness, rr^levance, and utility of the requirements. In this case, 
students' ratJjcigs were interpreted primarily as assessments of the instruct- 
or's organizationial ability and the degree to which the legitimate functions 
of the classroom were carried out. The average number of raters per 
instructor for Pequod was 75. ^ 

The third instrument on which students judged faculty was a semantic 
differential (Osgood)* This measure was made up of 30 bipolar adjective- 
pair items descriptive of various personality characteristics. The form 
mdjced adjective-pairs directly related to teaching (logical/illogical, 
organized/disorganized) xd.th those more associated with personal traits 
(bold/timid, warm/cold). Approximately 850 students rated faculty on the 
Osgood*. 

The three measures— IR iuid Pequod on teaching effectiveness and Osgood 
for personal characteristics — were obtained over a one and one-half year 
intervals ISfhlle some raters participated in all three assessments, others 
responded to only one of the instriiments. Therefore, the three assessments 
of faculty possess appreciable independence both over time and among raters. 

In. addition too descriptive statistics on each instrument, correlation 
coefficients » factor analysis, one-way analysis of variance, and multiple . 
regression analyses of the data were obtained. The level of significance 
for F and t-ratlos was set at .05. 

Eesults 

In. order to better interpret the Osgood criterion scores, faculty 
ratings on this instrument were examined using the factor analytic technique. 
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Results are reported in Table 1« The 30 Items coapxislng this criterion 
were factor analyzed using a prlnclpal-axls analysis with orthogonal ro- 
tation*. A five-factor solution provided four distinct personality com- 
ponents; the fifth factor produced no item loadings above the cut-off 
score. 

A cut-o££ score of .45 on factor loadings was used to determine which 
Items should be retaijied and which eliminated from the factors. No item 
appears^ in more than one factor.-^ Factor scores were computed for each 
instructor by sunmrlng his mean student ratings on each of the items loaded 
at or above .45 on the various factors. 



Insert Table 1 about here 



Factor I was labeled "Personal Potency." Loadings on the eight items 
ranged from .84 to .54, the highest being those of aggressiveness, bold- 
ness, and extroversion. The personally potent teacher is seen as one who 
is higbly attractive and who, by virttie of this attractiveness, is able 
to erert. considerable Influence over his students. The picture is that of 
a dynamic,- outz-going individual^ who, at the same time, communicates well 
with students and has a relaxed attitude.. The Importance of these last 
two items must: not be overlooked; without such teiiq>ering qualities, the 
profile would be one of brashness, bordering on the obnoxious — hardly the 
description of an influential individual » 

The two items comprising Factor II were labeled "Pragmatism." Factor 
loadings in the mid-seventies were obtained for both the practicable/impracti- 
cal and predictable/ unpredictable items. This factor appears to indicate . 
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a "cofflffion-seiise" or "do\m-to-earth" dimension to the teaching situation 
which students perceive as an important ingredient in effectiveness • 

T&ft third factor, "Amicability," contains items which describe an 
individual in terms of his friendliness and goodwill toward others. Inter- 
personal sensitivity is apparent in this pattern of traits. Sensitiveness, 
openinindedness, and acceptance on the part of faculty are especially im- 
portant: to students as reflected in the factor loading of .76, .73, and 
• 72 respectively. Reasonableness and graciousness, although less heavily 
loaded,, are also attributes desirable for effective Interpersonal 
relationships. 

FlSoally, Factor IV is made up of items indicative of a faculty 
member^'s "Intellectual Competency." Clearly eacpertise, knowledge, and 
vlsdOTi are essential aspects of this concept which also includes decisive- 
ness and. stability as well as rational and sensible behavior. 

Ecu considering the meanj.:ag of these derived factors, it is iB5)ortant 
to point: out that their interpretation Is based essentially on subjective 
^i::Jgment'« Nevertheless , the factors obtained from this Osgood instrument 
appear to resemble factors reported in previous research studies. Although 
each study uses its own unique nomenclature and thus introduces some * 
ambigaity, certain overlapping of the terms can be observed. Some examples 
are listed below. 

Factor* I. Personal Potency. 

Systematized Energy (Nunnally, Thistlethx^aite, and Wolfe, 1963) 

Lethargy vs. Energy (Solomon, Bezdek, and Rosenberg, 1964) 

Teaching Dynamism (Gulo, 1966) 

Patency (Schein and Hall, 1967) 



Factor II. Pragmatlsia> 

Organization Behavior (Gibb, 1955) 

Structure (Isaacson, McKeachie, and Milholland, 1963; 
Deshpande, Webb, and Marks, 1970) 
Factor III. Amicability . 

Empathy (Smalzried and Remmers, 1943; Coffman, 1954) 

Empathetic (Bendig, 1955) 

Friendly Democratic Behavior (Gibb, 1955) 

Warmth-Coldness (Solomon, Bezdek, and Rosenberg, 1964) 

Acceptance-Change (Gulo, 1966) 

Supportiveness (Schein and Hall, 1967) 

Bapport (Deshpande, Webb, and Marks, 1970) 
Factor IV. Intellectual Competency . 

Academic Emphasis (Gibb, 1955) 

Competence (Bendig, 1955) 

Skill (Isaacson, McKeachie, and Milholland, 1963) 
Competence (Schein and Hall, 1967) 
Content Mastery (Deshpande, Webb, and Marks, 1970) 
Analytic-Synthetic (Hildebrand and Wilson, 1970) 
The apparent commonality of elements within the various factor group- 
ings provides confidence that relevant teacher behavior patterns have been 
Identified, at least to the extent that these can be subjectively 
determined. 

2. Although the criteria assessed different aspects of teaching 
behavior, they were significantly intercorrelated, with the greatest degree 
of association occuring between the Osgood and Fequod instruments. 



Insert Table 2 about here 



These results are similar to those obtained by Haslow and Zismennan 
(1956) who obtained a correlation of .76 between student ratings of 
dLnst^lctors "as a teacher" and "as a personality*" 

In interpreting the significance of the intercorrelations in Table 2, 
It should be noted that the possibility of contamination froa halo effect 
(Cronbach, 1960), a common problem in many studies, is not an icsue here* 
In this study, methodological procedures made it impossible for any 
systematic bias to carry over from one instrument to another since each 
of the instruments was administered to different populations of students » 
under different conditions, and at different points in time* 

Critics of student evaluation frequently cite student grades as a 
Gource of halo effect in producing biased judgments of effectiveness* 
However, previous research has shown that grades havn little direct 
relationship to student ratings (Remmers, 1930; Elliott, 1950; Hudelson, 
1951; Voeks and French, I960; Lehmann, 1966; Bayder, 1968; Caffrey, 1969) • 
Results obtained in this study are similar to those of other researchers, 
namely, that the grades an instructor gives and the student evaluations 
he receives are not related* Correlation of average grade each instructor 
assigned with instructor mean IR rating using the Spearman rho formula 
produced a correlation coefficient of *13* 

Costln, Greenough, and Menges (1971) review other assumed relation- 
ships and find low order relations* It was therefore concluded that the 
significant intercorrelations among the three criteria were not the result 
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of biased stiulent judgments but that they did» in fact» reflect a strong 
interrelationship among three different dimensions of teacher behavior. 

3. In order to study the relationships between the Osgood factors 
and the teaching effectiveness criteria^ analysis of variance tests were 
made comparing high and low groups on each factor to the IR and Pequod 
ratings » High groiq>s contained factor scores above the mean; low groups 
contained facter scores at or below the mean. The decision to divide 
the scores into high-low groups resulted from uncertainty about the mean- 
ing of the intervals between individual raw scores. Somewhat greater 
confidence could be placed in obsexrvations based on differences between 
groups rather than differences among individuals. Table 3 reports the 
results of the analyses. 



Insert Table 3 about here 



These results show very large and statistically significant differences 
between the high and low groups for every factor in relation to the mean 
ratings of effectiveness on both the IR and Fequod. It is therefore con- 
cluded that meaningful patteims of social behavior have been identified » 
and these patterns appear to be directly related to students^ perceptions 
of teaching coispetency> 

4* In order to ascertain more specifically the relationship of the 
Osgood factors to the other criterion measures of effectiveness, multiple 
regression analyses were carried out. The following results were obtained: 
Predicting to Fequod, the multiple correlation (R) for the four factors 
was .Sd. ^le step-wi9e values of the multiple correlation of R were 
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Intellectual Competency » .78; Pragma tlsia» .83; Personal Potency » «87 
Amicability, .88. Predicting to IR, the multiple correlation was ,80. 
The step-wise values of the multiple correlation were Intellectual 
Competency, .74; Personal Potency, .79; Pragmatism, .80; Amicability, .80* 
In both cases, the resulting F-ratios were statistically significant 
beyond the .01 level. 



Insert Table 4 about here 



These findings are important for they demonstrate the possibility 
of predicting a faculty member^ s success in the classroom on the basis 
of his perceived personality characteristics. 

iPlscusslon and Conclusions 
Uhlle correlation analysis is not causal and an uncertainty remains 
as to whether or not faculty who are dynamic, pragmatic, amicable, and 
highly intellectually competent are judged to possess these attributes 
because of the way they teach, or vice versa, the evidence leans toward 
the Importance of the personal characteristics as the cause of the per- 
ceived instructional effectiveness. If this interpretation is correct, 
colleges wishing to improve teachi^ng perfonnance face a difficult problem. 
While not known from a longitudinal study, it nonetheless seems reasonable 
that the personality characteristics are more enduring and therefore more 
difficult to change than are the functional behaviors typically associated 
with good teaching — clearness of assignments, fairness of tests, good use 
of class time, and the like (items from IR and Pequod). A professor wish- 
ing to improve his perceived effectiveness may best begin on personal 
O attributes rather than focusing his energy on course functions and 
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actlvltes which, on the surface seem more readily open to alteration. 
Similarly, when a college selects a new colleague from a pool of recruits 
the findings suggest careful attention should be paid to "extra" profess- 
lonal characteristics, if the institution places a high value on student 
judgment of teaching. 

As for future research, a study needs to be conducted on a larger 
and more diverse population of faculty so as to test the degree to which 
generalizations apply. Also, both student-perceived teaching effective- 
ness and faculty personal characteristics need to be related to actual 
student goal attainment. Too few studies link the two. A few exceptions 
can be noted (Solomon, Rosenberg, and Bezdek, 1984; Cohen and Berger, 
1970; McKeachie, Lin, and Mann, 1971; Rodin and Rodin, 1972; Granzin and 
Pai^ter» 1973; Gessner, 1973). Even here, however, contradictory results 
(correlations of +.77 to -.75) create uncertainties as to the actual 
relationship between student-rated teaching effectiveness and accomplish- 
ment In courses. Confusions in this critical area contribute to low 
correlations between administrator, peer, self, and student ratings of 
teaching effectiveness (Blackburn and Clark, 1974). Furthermore, such 
ambiguities tindoubtedly heighten faculty stress and thereby iiqaede 
progress toward the very goal they desire, increased teaching effective- 
ness (Clark and Blackburn, 1973). Research is urgently needed on teach- 
ing effectiveness and the exraluation of faculty job performance if sub- 
stantive improvement i» to be made in the quality of the educational 
process. 
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^One exception was made in the case of the adjective pair, strong/ 
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was included as a component of Factor I because of the relatively 
greater magnitude of the loading on that factor as well as the apparent 
conceptual consistency of the item within Factor I. 
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TABLE 1 

Factors and. Factor Loadings of Student Perceptions 

of Faculty on the Osgood Effectiveness Rating 
(Nuaiber of Faculty=75; Number of Student Raters«850) 



O 0 

0) <u 

u u 

41 O 



ITEM 



III 



ri ^ 
fl-i a 

IV 





.84 


.25 


.04 


.09 


Aggressive/L^aggressive • ^ . 


.82 


.18 


.13 


.12 


Eictroverted/ Introverted . 


.80 


15 




10 


Active/Passive 


.76 


.07 


.25 


.34 




.73 


.04 


.17 


.16 




.67 


.19 


.22 


.50 


Good/Poor Communicator • • . 


.57 


.30 


.22 


.41 




.54 


.09 


.30 


.31 


Practical/Impractical .... 


.24 


.75 


.22 


.28 


Predictable /Unpredictable . . 


.11 


.73 


.00 


.12 


Sensitive/Insensitive .... 


.12 . 


.13 


.76 


.23 


Open-Minded/Closed-Minded . . 


.29 


-.01 


.73 


.24 




.27 


.17 


.72 


.14 


Keasonablc/Unreasonable . . . 


.41 


.34 


.53 


.28 


Gradous/Crude 


-.01 


.22 


.46 


.26 




.10 


.17 


.20 


.85 


Kaovledgeable/Unknovledgeable 


.13 


.08 


.18 


.77 




.16 


.33 


.23 


.70 




.44 


.42 


.03 


.64 


Stable/Unstable 


.21 


.28 


.25 


.59 




.27 


.37 


.28 


.52 


Sensible/Not Sensible . • . • 


.18 


.39 


.29 


.47 


Cumulative Proportion of 










Total Variance^ 


.52 


.60 


.66 


.70 



^Based on all 30 items. Not shown above are 8 items which were 
omitted either because they had high multiple loadings on two 
or more factors or because their loadings on all four factors 
vern less than .45 (see Rumnel» 1970:441). 



Table 2 



Intercorrelations of Criterion Measures 
based oh Mean Student Ratings of 
Faculty Effectiveness 




Criterion Measures 



IR 

Osgood 
Pequod 



45 .77* 
63 .73* 



75 .86* 



*p < .01 



18 



TABLE 3 



Summary of Analyses of Variance of Osgood Factors 
and Faculty Effectiveness Ratings 





Factor ^ 


Measures of Effectiveness 


IR 


Fequod 




4-1 *J 
r-l td 

o 


Standard 
Deviation 


u 

s 


Faculty 
Mean Ratlnj;* 


Standard 
Deviation 


I. 


Personal Potency: 
















Group 1 — Low 


20 


6.45 


.85 


35 


26.50 


3.73 




Group 1 — High 


25 


7.40 


.42 


40 


31.60 


3.41 




P-ratlo 




22.40 






36.40 




II. 


Pragmatism: 
















Group 1 — Low 


17 


6.67 


.79 


30 


26.52 


4.30 




Group 2 — High 


28 


7.17 


.74 


45 


31.10 


3.32 




P-ratlo 




4.30 






26.20 




XT T 
III. 


Amicability: 
















Group 1 — Low 


23 


6.67 


.83 


40 


26.91 


3.81 




Group 2— -High 


22 


7.30 


.62 


35 


31.97 


3.25 




F— ratio 




7.79 






36.60 




IV. 


Intellectual 
















Competency 
















Croup 1 — Low 


17 


6.27 


.79 


30 


26.17 


3.60 




Group 2-- High 


28 


7.41 


.41 


33 


31.98 


2.93 




F-ratio 




37.60 






57.50 





Note. —All F-ratios are statistically significant beyond the .001 level. 



"Maxittuffl possible scores; IR?«9.00; Pequod«40.00. 



Table 4 



Step-vise Regression Analyses Using Mean Factor Ratings 
to Predict to Mean Ratings of Teaching Effectiveness 



Step 
No. 


Factor 


F-level 


Coef. 
of 
Mult 
Regr. 


Coef. 

of 
Deter* 


Incr. in 
Coef. 

of 
Deter. 


Prediction to Pequod Ratings 
Number of Faculty-75 


1 


IV. Intellectual 
Coiiq>etency . . 


115.12 


.78 


.61 


.61 


2 


II. Pragmatism . . 


21.37 


.83 


.70 


.08 


.3 


I. PersoTial 

Potency . . . 


17.63 


.8? 


.76 


.05 


A 


III. Amicability . 
F-ratlo: 60.39* 


4.68 


.88 


.77 


.01 



Prediction to IR Ratings 
Nui&ber of Faculty«45 



1 


IV. 


Intellectual 
Competency. . 


53.17 


.74 


.55 


.55 


2 


I. 


Personal 
Potency . . . 


9.06 


.79 


.63 


.07 


3 


II. 


Pragmatism . . 


1.17 


.80 


.64 


.01 


U 


III. 


Amicability . 


.03 


.80 


.64 


.CO 




F-ratio: 18.00* 











*p < .01 



